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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed 9/30/08 have been fully considered but they are not 
persuasive. 

As per remark on page 8, applicant argues that Tsumagari, Stonedahl and Koyama do 
not teach "obtaining a plurality of timestamps, each timestamp comprising an associated event 
marker and an associated time index referenced with respect to a time line of the information 
stream, wherein two or more timestamps can be associated with the same event marker" as 
recited in claim 1 and similarly in claim 15. 

In response, Tsumagari does teach such limitation, obtaining a plurality of timestamps 
(in Fig. 3, PTS; Col. 10, lines 15-22), each timestamp comprising an associated event marker 
(shown in at least Figs. 25, 27 - entry points; further clarified in that each PTS marks initiation of 
playback start time, whereby user enters reproduction path of VOBU at the beginning) and an 
associated time index referenced with respect to a time line of the information stream (in Figs. 
14-16, 23 - time of entries; further clarified in Col. 16, lines 15-21 - time intervals of PTS to 
PTS), wherein two or more timestamps can be associated with the same event marker (Figs. 
23, 27 - entry point for programming movie with multiple key frames in packet thereby multiple 
time stamps within entry point; Col. 10, lines 15-22; further clarified that the start of one PTS 
and the start of the next PTS defines the start and end of an initial playback unit, as seen in Col. 
16, lines 15-21). 

As per remark on pages 10 and 1 1 , applicant argues that Tsumagari does not teach to 
form "groups of segments, each group comprising those segments of the information stream 
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whose timestamps comprise tlie same event marl<er, and tlien presenting tlie groups" and 
presenting tlie groups. 

In response, Tsumagari does teach such limitation forming groups of segments (see at 
least Fig. 2, Video Object comprised of a set and cells), each group comprising those segments 
of the information stream whose timestamps comprise the same event marker (Figs. 23, 27 - 
entry point for programming movie with multiple key frames in packet thereby multiple time 
stamps within entry point; Col. 10, lines 15-22; further clarified that the start of one PTS and the 
start of the next PTS defines the start and end of an initial playback unit, as seen in Col. 16, 
lines 15-21) and presenting the groups (Figs. 23-25, 27 - entry points within recorded time as 
listed and indexed; further clarified in that a user can playback any program chain and start from 
entry point in Fig. 31, ST48-ST50). 

As such, all claims stand rejected, no claims are allowable. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign 
country or in public use or on sale in this country, more than one year prior to the date of 
application for patent in the United States. 

3. Claims 1, 2, 4, 8, 9-13, 15, 35, 36, 41 and 42 are rejected under 35 U.S.C. 102(b) as 
being anticipated by Tsumagari et al. (US 6,360,057 B1). 

Regarding Claim 1, Tsumagari et al. teaches a method for providing access to an 
information stream comprising: 
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• obtaining a plurality of timestamps (Fig. 3, PTS; Col. 10, lines 15-22), each timestamp 
comprising an associated event marker (shown in at least Figs. 25, 27 - entry points; 
further clarified in that each PTS marks initiation of playback start time, whereby user 
enters reproduction path of VOBU at the beginning) and an associated time index 
referenced with respect to a time line of the information stream (in Figs. 14-16, 23 - time 
of entries; further clarified in Col. 16, lines 15-21 - time intervals of PTS to PTS), wherein 
two or more timestamps can be associated with the same event marker (Figs. 23, 27 - 
entry point for programming movie with multiple key frames in packet thereby multiple 
time stamps within entry point; Col. 10, lines 15-22; further clarified that the start of one 
PTS and the start of the next PTS defines the start and end of an initial playback unit, as 
seen in Col. 16, lines 15-21); 

• producing segments of the information stream, each segment being associated with a 
timestamp and being determined based on the time index associated with the timestamp 
(Col. 9, line 48 - Col. 10, line 28 - VOBU with presentation time during interval); 

• forming groups of segments (see at least Fig. 2, Video Object comprised of a set and 
cells), each group comprising those segments of the information stream whose 
timestamps comprise the same event marker (Figs. 23, 27 - entry point for programming 
movie with multiple key frames in packet thereby multiple time stamps within entry point; 
Col. 10, lines 15-22; further clarified that the start of one PTS and the start of the next 
PTS defines the start and end of an initial playback unit, as seen in Col. 16, lines 15-21); 
and 

• presenting a representation of each event marker and a representation of its associated 
group of segments, wherein the representation is arranged according to an arrangement 
format (Figs. 23-25, 27 - entry points within recorded time as listed and indexed; further 
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clarified in tliat a user can playbacl< any program cliain and start from entry point in Fig. 
31, ST48-ST50). 

Regarding Claim 2, Tsumagari et al. teaclies tlie metliod of claim 1 wherein the 
arrangement format is determined automatically, absent user-provided arrangement information 
(Fig. 32, entry point by recorder; Col. 28, line 53 - Col. 29, line 34). 

Regarding Claim 4, Tsumagari et al. teaches the method of claim 1 wherein each event 
marker is information produced by a user action (Fig. 32 - entry point by user; Col. 28, line 53 - 
Col. 29, line 34) and each associated time index is the time of occurrence of the user action 
(Figs. 14-16, 23 - time of entries; Fig. 27 - entry points per recorded time in various programs). 

Regarding Claim 8, Tsumagari et al. teaches the method of claim 1 wherein each 
timestamp is further associated with a recording device (in at least Figs. 26, 29 - wherein all 
timestamps are associated with device), wherein the method is applied only to those 
timestamps that are associated with the same recording device (in at least Figs. 26, 29 - 
wherein all timestamps are associated with device). 

Regarding Claim 9, Tsumagari et al. teaches the method of claim 1 wherein a segment 
of the information stream spans a period of time relative to an associated time index (Figs. 14- 
1 6, 23 - period of time of entries). 

Regarding Claim 10, Tsumagari et al. teaches the method of claim 1 further comprising 
recording the information stream (in at least Col. 1, lines 16-26), wherein the timestamps are 
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recorded at the time of recording of tlie information stream (Figs. 23-25, 27 - entry points witliin 
recorded time as listed and indexed). 

Regarding Claim 11, Tsumagari et al. teaclies tlie metliod of claim 1 wherein the 
information stream is a previous recording, the method further comprising recording the 
timestamps during playback of the information stream (Figs. 36, 37, 46, 47). 

Regarding Claim 12, Tsumagari et al. teaches the method of claim 1 wherein the 
information stream comprises one of continuous information and discrete information (in at least 
Figs. 2,3- wherein VOB, cells, VOBU's, etc have finite playback time). 

Regarding Claim 13, Tsumagari et al. teaches the method of claim 1 wherein the step 
of presenting includes producing images on a display device (Fig. 35). 

Regarding Claim 15, Tsumagari et al. teaches a method for providing access to an 
information stream comprising: 

• obtaining a plurality of timestamps (Fig. 3, PTS; Col. 10, lines 15-22), each timestamp 
comprising an associated event marker (shown in at least Figs. 25, 27 - entry points; 
further clarified in that each PTS marks initiation of playback start time, whereby user 
enters reproduction path of VOBU at the beginning) and an associated time index 
referenced with respect to a time line of the information stream (in Figs. 14-16, 23 - time 
of entries; further clarified in Col. 16, lines 15-21 - time intervals of PTS to PTS), wherein 
two or more timestamps can be associated with the same event marker (Figs. 23, 27 - 
entry point for programming movie with multiple key frames in packet thereby multiple 
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time stamps witliin entry point; Col. 10, lines 15-22; further clarified that the start of one 
PTS and the start of the next PTS defines the start and end of an initial playback unit, as 
seen in Col. 16, lines 15-21); 

• producing segments of the information stream, each segment being associated with a 
timestamp and being determined based on the time index associated with the timestamp 
(Col. 9, line 48 - Col. 10, line 28 - VOBU with presentation time during interval); 

• forming groups of segments (see at least Fig. 2, Video Object comprised of a set and 
cells), each group comprising those segments of the information stream whose 
timestamps comprise the same event marker (Figs. 23, 27 - entry point for programming 
movie with multiple key frames in packet thereby multiple time stamps within entry point; 
Col. 10, lines 15-22; further clarified that the start of one PTS and the start of the next 
PTS defines the start and end of an initial playback unit, as seen in Col. 16, lines 15-21); 

• receiving a source image comprising images of the event markers and annotative 
information proximate each event marker (Col. 9, line 59 - Col. 10, line 23 - VOBU 
having groups of pictures, wherein each pack has presentation time stamps and entry 
points; Fig. 27); 

• for each event marker contained in the source image, presenting a plurality of images 
including an image of the event marker (in at least Figs. 35, 36, 38, 39 - playback of 
video from selected entry point), an image representative of the group of segments 
associated with the event marker, and an image of the annotative information proximate 
the event marker (in at least Figs. 35, 36, 39 - entry point playback having thumbnail 
with text), wherein the plurality of images are grouped together (in at least Col. 9, lines 
59+ - VOBU having groups of pictures). 
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Regarding Claim 35, Tsumagari et al. teaches a processor for providing access to an 
information stream comprising a data processing component operable to perform tlie metliod 

steps of: 

• receiving at least a first information stream (Figs. 1-3 - video stream of disc); 

• receiving a plurality of first event markers (Fig. 27 - entry points), the first event markers 
having timing information associated therewith (in Figs. 14-16, 23 - time of entries; 
further clarified in Col. 16, lines 15-21 - time intervals of PTS to PTS); 

• timestamping the first information stream with the first event markers (Fig. 3, PTS; Col. 
10, lines 15-22), including identifying points in time in the first information stream based 
on the timing information (Col. 9, line 59 - Col. 1 0, line 23 - VOBU having groups of 
pictures, wherein each pack has presentation time stamps and entry points; Fig. 27) 
associated with the event markers and associating the points in time in the first 
information stream with the first event markers (Figs. 23, 27 - entry point for 
programming movie with multiple key frames in packet thereby multiple time stamps 
within entry point; Col. 10, lines 15-22; further clarified that the start of one PTS and the 
start of the next PTS defines the start and end of an initial playback unit, as seen in Col. 
16, lines 15-21); 

• grouping together those points in time in the first information stream that are 
timestamped with the same event marker to produce one or more groups of media 
segments (Fig. 27 - creation of various playlists with entry points); and 

• presenting the groups of media segments (Fig. 38 - playback according to selection). 

Regarding Claim 36, Tsumagari et al. teaches the processor of claim 35 wherein the 
first event markers further have device information associated therewith (Fig. 27 - creation of 
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various playlists witli entry points), tlie device information being indicative of tlie device wliicli 
produced tfie first information stream (in at least Figs. 26, 29 - wlierein all timestamps are 
associated with device), winerein the step of grouping is performed on those the first event 
mariners that are associated with the same device information (in at least Figs. 26, 29 - wherein 
all timestamps are associated with device). 

Regarding Claim 41, Tsumagari et al. teaches a method for accessing an information 
stream comprising: 

• detecting a first action of reading a marker (Fig. 3, PTS; Col. 10, lines 15-22); 

• storing first information representative of the marker (Figs. 23-25, 27 - entry points 
within recorded time as listed and indexed); 

• associating a first time value with the first information, the first time value representative 
of the time of the first action (Figs. 23, 27 - entry point for programming movie with 
multiple key frames in packet thereby multiple time stamps within entry point; Col. 10, 
lines 15-22; further clarified that the start of one PTS and the start of the next PTS 
defines the start and end of an initial playback unit, as seen in Col. 16, lines 15-21); 

• detecting a second action of reading the marker (Fig. 3, PTS; Col. 10, lines 15-22; Fig. 
38 - second action for reading entry point if still remaining); 

• associating a second time value with the first information (Fig. 3, PTS; Col. 10, lines 15- 
22; Fig. 38 - addition of second entry point during recorded time; Figs. 23-25, 27), the 
second time value representative of the time of the second action (Figs. 23, 27 - entry 
point time position for programming movie with multiple key frames in packet thereby 
multiple time stamps within entry point; Col. 10, lines 15-22; for second point); 
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• accessing a first segment of an information stream, tlie first segment being based on tlie 
first time value (Col. 9, line 48 - Col. 10, line 28 - VOBU with presentation time during 
Interval; Figs. 23, 27 - entry point for programming movie with multiple key frames In 
packet thereby multiple time stamps within entry point; Col. 10, lines 15-22); 

• accessing a second segment of the information stream (Fig. 3, PTS; Col. 10, lines 15- 
22; Fig. 38 - reading of second entry point when entry point still remains after first), the 
second segment being based on the second time value (Figs. 23, 27 - entry point time 
position for programming movie with multiple key frames in packet thereby multiple time 
stamps within entry point; Col. 10, lines 15-22; for second point); 

• presenting the first segment and the second segment along with the marker (Figs. 23- 
25, 27 - entry points within recorded time as listed and indexed; Fig. 38 - presentation 
from selected entry). 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention Is not Identically disclosed or 
described as set forth In section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a 
whole would have been obvious at the time the invention was made to a person having 
ordinary skill In the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

5. Claims 5-7 and 38-40 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Tsumagari et al. (US 6,360,057 B1) in view of Stonedahl (US 2002/0199198 A1). 
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Regarding Claim 5, Tsumagari et al. teaches the method of claim 4 but fails to explicitly 
teach wherein the user action is scanning of a barcode, wherein the marker is representative of 
the barcode that Is scanned, wherein scanning the barcode more than once produces one or 
more time indices associated with the barcode. Stonedahl teaches wherein the user action is 
scanning of a barcode, wherein the marker is representative of the barcode that is scanned, 
wherein scanning the barcode more than once produces one or more time indices associated 
with the barcode (Paragraphs [0038,0040] - selection based on barcode scanning by a number 
of selections based on time). 

A person of ordinary skill in the art would have had good reason to pursue the known 
options of giving the user control over selecting through usage of a scanning a barcode. It would 
require no more than "ordinary skill and common sense," to give the user control over digitally 
and physically pointing and selecting to preferred portions of events to designate as desired 
portions. 

Regarding Ciaim 6, Tsumagari et al. teaches the method of claim 4 but fails to explicitly 
teach wherein the user action is speaking a phrase, wherein the event marker is representative 
of a digital representation of the phrase, wherein speaking the phrase more than once produces 
one or more time indices associated with the digital representation of the phrase. Stonedahl 
teaches wherein the user action is speaking a phrase, wherein the event marker is 
representative of a digital representation of the phrase, wherein speaking the phrase more than 
once produces one or more time indices associated with the digital representation of the phrase 
(Paragraphs [0038,0040] - selection based by sounds of participant by a number of selections 
based on time). 
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A person of ordinary sl<ill in tlie art would liave liad good reason to pursue tlie l<nown 
options of giving tlie user control over selecting through speaking. It would require no more than 
"ordinary skill and common sense," to give the user control over digitally and physically (by 
nature of tonal) pointing and selecting to preferred portions of events to designate as desired 
portions. 

Regarding Claim 7, Tsumagari et al. teaches the method of claim 4 but fails to explicitly 
teach wherein the user action is a selecting a visual element with an input device, wherein the 
event marker is representative of the visual element, wherein selecting the visual element more 
than once produces one or more time indices associated with the visual element. Stonedahl 
teaches wherein the user action is a selecting a visual element with an input device, wherein the 
event marker is representative of the visual element, wherein selecting the visual element more 
than once produces one or more time indices associated with the visual element (Paragraphs 
[0038,0040,0043] - selection based on barcode scanning by a number of selections based on 
time). 

A person of ordinary skill in the art would have had good reason to pursue the known 
options of giving the user control over selecting through usage of a scanning a barcode. It would 
require no more than "ordinary skill and common sense," to give the user control over digitally 
and physically (by means of visual cues) pointing and selecting to preferred portions of events 
to designate as desired portions. 

Regarding Ciaim 38, Tsumagari et al. teaches the processor of claim 35 but fails to 
explicitly teach wherein the event markers are representative of scanned barcodes. Stonedahl 
teaches wherein the event markers are representative of scanned barcodes (Paragraphs 
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[0038,0040,0043] - selection based on barcode scanning by a number of selections based on 
time). 

A person of ordinary skill in the art would have had good reason to pursue the known 
options of giving the user control over selecting through usage of a scanning a barcode. It would 
require no more than "ordinary skill and common sense," to give the user control over digitally 
and physically pointing and selecting to preferred portions of events to designate as desired 
portions. 

Regarding Claim 39, Tsumagari et ai. teaches the processor of claim 35 but fails to 
explicitly teach wherein the event markers are representative of selected graphics. Stonedahl 
teaches wherein the event markers are representative of selected graphics (Paragraphs 
[0038,0040,0043] - selection visually based by graphic barcode scanning by a number of 
selections based on time). 

A person of ordinary skill in the art would have had good reason to pursue the known 
options of giving the user control over selecting through usage of a scanning a barcode. It would 
require no more than "ordinary skill and common sense," to give the user control over digitally 
and physically (by means of visual cues) pointing and selecting to preferred portions of events 
to designate as desired portions. 

Regarding Claim 40, Tsumagari et al. teaches the processor of claim 35 but fails to 
explicitly teach wherein the event markers are representative of spoken phrases. Stonedahl 
teaches wherein the event markers are representative of spoken phrases (Paragraphs 
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[0038,0040] - selection based by sounds of participant by a number of selections based on 
time). 

A person of ordinary skill in the art would have had good reason to pursue the known 
options of giving the user control over selecting through speaking. It would require no more than 
"ordinary skill and common sense," to give the user control over digitally and physically (by 
nature of tonal) pointing and selecting to preferred portions of events to designate as desired 
portions. 

6. Claims 3, 14 and 37 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Tsumagari et al. (US 6,360,057 B1) in view of Koyama et al. (US 6,424,385 B1). 

Regarding Claim 3, Tsumagari et al. teaches the method of claim 1 but fails to explicitly 
teach wherein each of the event markers is uniquely represented on a sheet, wherein the 
arrangement format is determined according to an arrangement of the event markers on the 
sheet. Koyama teaches wherein each of the event markers is uniquely represented on a sheet, 
wherein the arrangement format is determined according to an arrangement of the event 
markers on the sheet (Col. 7, lines 42-28 - printer printing image per one image on paper 
wherein only one time stamp applies). 

A person of ordinary skill in the art would have had good reason to pursue the known 
options of allowing a physical copy of an image representative of an event to be printed onto a 
physical medium such as paper. It would require no more than "ordinary skill and common 
sense," to have selected portions of events distributed as images and printed onto a sheet. 
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Regarding Claim 14, Tsumagari et al. teaches the method of claim 1 but fails to 
explicitly teach wherein the step of presenting includes producing images on a printable 

medium. Koyama teaches wherein the step of presenting includes producing images on a 
printable medium (Col. 7, lines 42-28 - printer printing image per one image on paper). 

A person of ordinary skill in the art would have had good reason to pursue the known 
options of allowing a physical copy of an image representative of an event to be printed onto a 
physical medium such as paper. It would require no more than "ordinary skill and common 
sense," to have selected portions of events distributed as images and printed onto a sheet. 

Regarding Ciaim 37, Tsumagari et al. teaches the processor of claim 35 but fails to 
explicitly teach wherein presenting the groups of media segments comprises, for each group of 
media segments, producing an image representative of each media segment and forming the 
image on a printable medium. Koyama teaches wherein presenting the groups of media 
segments comprises, for each group of media segments, producing an image representative of 
each media segment and forming the image on a printable medium (Col. 7, lines 42-28 - printer 
printing image per one image on paper wherein only one time stamp applies). 

A person of ordinary skill in the art would have had good reason to pursue the known 
options of allowing a physical copy of an image representative of an event to be printed onto a 
physical medium such as paper. It would require no more than "ordinary skill and common 
sense," to have selected portions of events distributed as images and printed onto a sheet. 
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Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of tlie extension of time policy as 

set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing date 
of this final action. 

Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Michael Choi whose telephone number is (571) 272-9594. The examiner 
can normally be reached on Monday - Friday 9:00AM - 5:30PM (EST). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha Banks-Harold can be reached on (571) 272-7905. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding tlie status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you 
would like assistance from a USPTO Customer Service Representative or access to the 
automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Marsha D. Banks-Harold/ /Michael Choi/ 

Supervisory Patent Examiner, Art Unit 2621 Examiner, Art Unit 2621 



